Performance Analysis of ^i-synthesis with Coherent Frames 

Yulong Liu* Shidong Lij and Tiebin Mi* 



Abstract 

Signals with sparse frame representations comprise a much more realistic model of 
nature than that with orthonomal bases. Studies about the signal recovery associated 
with such sparsity models have been one of major focuses in compressed sensing. In 
such settings, one important and widely used signal recovery approach is known as t\- 
synthesis (or Basis Pursuit). We present in this article a more effective performance 
analysis (than what are available) of this approach in which the dictionary D may be 
highly, and even perfectly correlated. Under suitable conditions on the sensing matrix 

an error bound of the recovered signal f (by the £i-synthesis method) is established. 
Such an error bound is governed by the decaying property of D*f , where f is the true 
signal and D Q denotes the optimal dual frame of D in the sense that ||D*f ||i produces 
the smallest ||D*f ||i in value among all dual frames D of D and all feasible signals f. 
This new performance analysis departs from the usual description of the combo <1?D, 
and places the description on <&. Examples are demonstrated to show that when the 
usual analysis fails to explain the working performance of the synthesis approach, the 
newly established results do. 

Keywords: Compressed sensing, coherent frames, l\ -synthesis, optimal-dual-based 
£i-analysis. 
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1 Introduction 

Compressed sensing is a new data acquisition theory which allows that sparse or compressible signals 
of interest can be recovered from a small number of linear, non-adaptive, and usually randomized 
measurements (SHU [13]. By now, compressed sensing has attacked abundant applications in signal 
and image processing, see e.g., the two special issues [I], [2] and references therein. Formally, one 
considers the following measurement model: 

y = $f + z, (1) 

where <& is an m x n sensing matrix with m n (indicating some significant undersampling) and 
z £ M m is a noise term modeling measurement error. The goal is to reconstruct the unknown signal 
f € K n based on available measurements y G M. m . 

In standard compressed sensing scenarios, it is usually assumed that the signal f has a sparse 
(or nearly sparse) representation in an orthonormal basis. However, a large number of applications 
in signal and image processing point to problems where f is sparse with respect to an overcom- 
plete dictionary or a frame rather than an orthonormal basis, see, e.g., [24], [II], [4], and references 
therein. Examples include, e.g., signal modeling in array signal processing (oversampled array steer- 
ing matrix), reflected radar and sonar signals (Gabor frames), and images with curves (curvelets), 
etc. The flexibility of frames is the key characteristic that empowers frames to become a natural 
and concise signal representation tool. Therefore, it is highly desirable to extend the compressed 
sensing methodology to redundant dictionaries as apposed to orthnormal bases only, see, e.g., [25] . 
|10j . [22j. In such sparse frame representation setting, the signal f is now expressed as f = Dx 
where D E M. nxd (n < d) is a matrix of framqj vectors (as columns) that are often rather coherent 



1 A set of vectors {dk}kei in R" is a frame of R n if there exist constants < A < B < oo such that 

Vfet", A\\f\\l <^|(f,d fe }| 2 <s||f|| 



ill, 



fcei 

where numbers A and B are called lower and upper frame bounds, respectively. More details about frames can be 
found in e.g., p]. [T5]. 



in applications, and x € R is a sparse coefficient vector. The linear measurements of f then can be 
written as 

y = *Dx + z. (2) 

Since x is assumed sparse, the standard way of recovering f from ([2]) is known as £i-synthesis 
(or synthesis-based method) [TT], [IB], [TO]. Prom the measurements, one first finds the sparsest 
possible coefficient x by solving an i\ minimization problem 

x = argmin||x||i s.t. ||y — 3>Dx||2 < e, (3) 



where ||x|L {p = 1, 2) denotes the standard £ p -norm of the vector x and e is an upper bound of the 
noiscl Then the solution to f is derived via a synthesis operation, i.e., f = Dx. 

Although empirical studies show that ^i-synthesis often achieves good recovery results, the the- 
oretical performance of this method is far from satisfactory. The analytical results in |25j essentially 
require that the frame D has columns that are extremely uncorrelated such that the compound 
matrix $D satisfies the requirements imposed by the traditional compressed sensing assumptions. 
However, these requirements are often infeasible when D is highly coherent. For example, consider 
a simple case in which 3> 6 jg>mxn - g a Q auss i an ma trix with i.i.d. entries, then <& ~ M (0, I n ® I m ), 
where ® denotes the Kronecker product and I m is an identity matrix of the size m. It is now well 
known that with very high probability 3> satisfies the restricted isometry property (RIP) [5J provided 
that m is on the order of slog(n/s) [3], [8]. Let us now examine 3>D. It is not hard to show that 
3>D ~ M (0, D*D (g> I m ), where (•)* denotes the transpose operation. If D is unitary, then 3>D has 
the same distribution as and hence satisfies the RIP. However, if D is a coherent frame, then 
$D may no longer obey the common RIP since the entries of 3>D are correlated. Meantime, the 
mutual incoherence property (MIP) [14] may not apply either, as it is very hard for 3>D to satisfy 
the MIP as well when D is highly correlated. 



2 The extension to the Gaussian noise case is straightforward since with large probability, the Gaussian noise belongs 
to bounded sets, see, e.g., lemma 5.1 in [5]- 



The perspective of the results in [25] is that some sufficient conditions are put on the compound 
matrix <1?D such that x can be recovered accurately, which leads to a good estimate of f . However, 
if one is only interested in reconstructing the signal f and may not care about obtaining a good 
recovery of x. As pointed out in [TO], when the dictionary D has two identical columns, it seems 
impossible to recover a unique sparse coefficient vector x from the measurements, but we may 
certainly be able to reconstruct the signal f accurately. In other words, a good recovery of x may 
be unnecessary to guarantee an accurate reconstruction of f . 

We observe in abundant examples that the ^i-synthesis method is also capable of producing fine 
approximation of f without recovering accurate coefficient vector x. Known analysis results such as 
|25j would then not be able to explain these fine results by the synthesis approach. 

In this article, we present a new performance analysis for the £i-synthesis approach ([3]) in which 
the dictionary D may be highly - and even perfectly - correlated. To the best knowledge of the 
authors, our new results are more effective than what are known and available. Our results do not 
depend on a good recovery of the coefficients. The basic idea is to establish the equivalence between 
the ^i-synthesis approach and the optimal-dual-based ^i-analysis approach recently proposed in |22j . 
Then the recovery error bound for the latter will naturally lead to that for the former. 

This paper is organized as follows. Section [2] introduces the family of analysis-based approaches 
which includes the standard £i-analysis, the general-dual-based ^i-analysis, and the optimal-dual- 
based ^-analysis. In Sectional the equivalence between the £i-synthesis and the optimal-dual-based 
£i-analysis is established. The new performance analysis (error bound) for the £i-synthesis is then 
naturally followed from that of the optimal-dual based £i-analysis approach. Some numerical exper- 
iments are presented in Section [4] to demonstrate the effectiveness of the results obtained in Section 
02 These examples show that when the usual analysis fails to explain the working performance of 
the synthesis approach, our newly established results do. Conclusion remarks are given in Section 
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2 The Family of Analysis-based Approaches Based on General 
Dual Frames 

Alongside the £i-synthesis approach, there is a counterpart that takes an analysis point of view, see 
e -g-i [E]> |16| . [10j . This alternative finds an estimate of f directly by solving the problem 

f = argmin||D*f ||i s.t. ||y — $f H2 < e, (4) 

fgR" 

where D denotes the canonical dual frame of D, i.e., D = (DD*) _1 D. Note that if D is a Parseval 
frame, then we have D = D. 

It is well known by now |16| that when D is a square and invertible dictionary, the £i-analysis 
and ^i-synthesis approaches are equivalent. However, when D is an overcomplete frame, the gap 
between them exists. 

A remarkable performance study of the £i-analysis approach (J4]) in the case of Parseval frames 
(D = D) was given in [ID]. It was shown that, under suitable conditions on the sensing matrix 
3>, the solution to @ is very accurate provided that D*f has rapidly decreasing coefficients. In 
other words, when the frame coefficient vector D*f is reasonably sparse, £i-analysis can be the right 
method to use. 

However, that f is sparse in terms of D does not imply D*f is necessarily sparse. In fact, as 
the canonical dual frame expansion in the case of Parseval frames, D*f = D*Dx has the minimum 
^2-norm by the frame property, see, e.g., [T2J and is usually fully populated which is also pointed 
out in [25]. In other words, the canonical dual frame of D may be ineffective in sparsifying f since 
^2-norm tends to spread the coefficients into a large number of small coefficients. 

To overcome this difficulty, the standard ^i-analysis approach @ has recently been extended to 
a more general case in which the analysis operator can be any dual framed of D [22J. This leads to 



3 A frame {dk}kei is an alternative dual frame of {dk}kei if 

V f £ R", f = ^<f,dfc> dfc = 53(f,d fc ) d k 



the following general-dual-based ^-analysis approach 

f = argmin||D*f ||i s.t. ||y — &i \\% < e, (5) 

feM™ 

where columns of D form a general (and any) dual frame of D. The performance analysis of the 
general-dual-based ^i-analysis approach was also given in [22]. In order to introduce the results, 
we require the concept of D-RIP [10J: An m x n sensing matrix <1? is said to satisfy the restricted 
isometry property adapted to D (abbreviated D-RIP) with constant 5 S G (0, 1) if 

(i-a.)IMl! < ||*v|H < (i + <5.)IMIl (6) 

holds for all v G S s , where S s is the union of all subspaces spanned by all subsets of s columns of 
D. The validity of the D-RIP was discussed in e.g., |10| . [20]. It was shown in [10] that any m x n 
matrix 3> obeying for any fixed v G W 1 

Pr (|||*i/||| - Mil > *Mla) < ce"^ m , 5 G (0, 1) (7) 

(7, c are positive constants) will satisfy the D-RIP with overwhelming probability provided that m 
is on the order of slog(d/s). Many types of random matrices satisfy (|7|), some examples include 
matrices with Gaussian, subgaussian, or Bernoulli entries. It has also been shown in [20] that 
randomizing the column signs of any matrix that satisfies the standard RIP results in a matrix 
which satisfies the Johnson-Lindenstrauss lemma |19] . Such a matrix would then satisfy the D-RIP 
via ([7]). Consequently, partial Fourier matrix (or partial circulant matrix) with randomized column 
signs will satisfy the D-RIP since these matrices are known to satisfy the RIP. 
With these preliminaries, we now restate the results in |22] as follows. 

Theorem 1. jl22\j Let D be a general frame ofM. n with frame bounds < A < B < 00. Let D be an 
alternative dual frame of D with frame bounds < A < B < 00, and let p = s/b. Suppose 

(l-y/^B^j ■ 5 s+a + pBB ■ 5 b < 1 - 2\fp~B^ (8) 
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holds for some positive integers a and b satisfying < b — a < 3a. Then the solution f to (0) satisfies 

l|f-f|b< C ,. e + Cl . l|6,f -' 6,f) ' 11 ' , (9) 

where Co and Cx are some constants and (D*f) s denotes the vector consisting the largest s entries 
o/D*f in magnitude (and setting the other to zero). 

Theorem [1] shows that if $ satisfies some proper conditions, e.g., ©, then the solution to © is 
very accurate provided that D*f has rapidly decreasing coefficients. By the definition of the D-RIP, 
the condition ([8]) is independent of the coherence of the dictionary D. For differently chosen a and 
6, ([8]) will give rise to different conditions on the D-RIP constants 5 s + a and 5^. For instance, if D 
is a Parseval frame and D is its canonical dual frame, i.e., BB = 1, then (JSj) is satisfied whenever 
5 2s < 0.1398 [22]. 

With the error bound we can easily see the potential superiority of using alternative dual 
frames as analysis operators. For clarity, we consider a simple case in which the noise is free, i.e., 
e = 0. Then the error bound ([9]) reduces to 

Hf-fll 2 < Cl . g£^ggA . (io) 

Clearly, the quality of the bound ||D*f — (D*f) s ||i/y / s in (fTUj) is measured in terms of how effective 
D*f is in spasifying the signal f with respect to the dictionary D. To explain, suppose that f has a 
sparse representation in D, i.e., f = Dx, where x is a sparse coefficient vector. As discussed before, 
the canonical dual frame expansion of f has the minimum ^2- norm > i-e., ||D*f ] 1 2 = min 1 1 5c 1 1 2 , and 

x:Dx=f 

is ineffective in promoting sparsity in general. On the other hand, when the analysis operator can be 
any dual frame of D, it is not hard to imagine that there should be some dual frame of D, denoted 
by D5, such that DJf = x. This is due to the fact that all coefficients of a frame expansion of f 
in D should correspond to some dual frame of D, which really is the spirit of frame expansions. 
Generally, D5 is much more effective in sparsifying the signal f than the canonical dual frame does. 
Therefore, one may expect a better recovery performance by taking some "proper" alternative dual 
frame as the analysis operator. 



The important question then is how to choose some appropriate dual frame such that the corre- 
sponding analysis coefficients are as sparse as possible. Since the true f is never known before hand 
in practice, it seems to impossible to explicitly construct some proper dual frame D such that D*f 
is sparse without additional priori knowledge about the signal f . One approach proposed in |22j is 
by the method of optimal-dual-based l\ -analysis: 

f= argmin ||D*f||i s.t. ||y — <&f H2 < e, (11) 

DD*=I, fgR" 

where the optimization is performed simultaneously over both all dual frames D of D and the 
feasible signal set. This seemingly complicated optimization problem can be reformulated into a 
simplified form. Note that the class of all dual frames for D is given by [21] 

D = (DD*)^D + W*(I d - D*(DD*) _1 D) = D + W*P, (12) 

where P = 1^ — D*(DD*) X D denotes the orthogonal projection onto the null space of D and 
W G M. dxn is an arbitrary matrix. Plug f)12|) into (jlip . we obtain 

(f , g) = argmin ||D*f + Pg||i s.t. ||y - *f|| 2 < e, (13) 

f€R™, gGR d 

where we have used the fact that when f / 0, g = Wf can be any vector in M. d due to the fact 
that W is free. Note that if Pg = 0, then (fT3j) reduces to the standard ^-analysis approach @. 
In [22], an iterative algorithm based on the split Bregman iteration |17j was developed to solve the 
optimization problem (|13j) efficiently. 

Clearly, the solution to (fTT]) definitely corresponds to that of ([5]) with some "optimal" dual 
frame, say D Q as the analysis operator. The optimality here is in the sense that ||D*f ||i achieves the 
smallest ||D*f ||i in value among all dual frames D of D and feasible signals f satisfied the constraint 
in (fTT|) . Once f and g are obtained (through solving (fT3j) ). it follows from (fT2j) that the analysis 
operator D* is given by 

D* = D* + PW , (14) 
8 



with W Q satisfying 

g = W Q f . (15) 

Evidently, the optimal dual frame D Q depends on the solutions of (|13p . By utilizing the fact that 
vec(ABC) = (C* ® A)vec(B), the above equation (fT5j) is equivalent to 

(f* ® I d ) • vec(W ) = g, (16) 

where vec(W Q ) denotes the vectorization of the matrix W Q by stacking the columns of W D into a 
single vector. Evidently, the solution to (|16p is non-unique in general since this equation is highly 
underdetermined with n equations but nd unknowns. The class of solutions to (|16p is given by 

vec(W ) = (f* ® I d )tg + (l nd - (f* ® I d )t(f* ® I d )) w 

= (f ® Id)g/||f Hi + (lnd ~ (ff* ® Id)) w/||f |||, (17) 

where denotes the pseudo-inverse of A and w G ]g na!xl j s an arbitrary vector. In deriving (I17p . 
we have used the two facts that (A ® B)^ = A" 1 " ® B" 1 " and (A ® B)(C ® D) = AC ® BD, see e.g., 
[23] . Let w = 0, then (JTTj) reduces to the least square solution of W Q 

W|f = (f*®g)/||f|||. (18) 

If we choose W Q = W„ , then (JTSJ) becomes 

D* = D* + PW^ = D* + (f* ® Pg)/||f|||. (19) 

It is this form (|19|) which will be used to construct the optimal dual frame in the numerical experi- 
ments. 

Figure Q] provides a schematic overview of the family of dual-based £i-analysis approaches. For 
the standard ^i-analysis approach ^ which uses the canonical dual frame of D as the analysis 
operator, the recovered signal f has the smallest ||D*f||i in value among the feasible signal set. 
While for the optimal-dual-based £i-analysis approach (jlip . the optimization is not only over the 
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Figure 1: A schematic overview of the family of dual-based £i-analysis approaches 

feasible signal set but also over all dual frames D of D. The recovered signal f and optimal dual 
frame D Q (non-unique) produce the smallest ||D*f ||i in value. When the signal of interest has a 
sparse representation in a redundant frame, one may expect that the optimal dual frame may be 
much effective in sparsfying the true signal than the canonical dual frame does. Then a better 
recovery performance may be achieved by the optimal-dual-based ^i-analysis approach. Indeed, 
we have seen that the signal recovery via (jlip is much more effective than that of the standard 
£i-analysis approach (jj]) which uses the canonical dual frame as the analysis operator. Moreover, 
the optimal-dual-based analysis method provides a new and more effective performance analysis to 
the £i-synthesis approach. 





3 Performance Analysis of l\- Synthesis 

In this section, we present a new performance analysis of the ^i-synthesis approach. We begin by 
showing that the £i-synthesis and the optimal-dual-based £i-analysis approaches are equivalent. 

Theorem 2. l\-synthesis and optimal- dual-based i\-analysis are equivalent. 

Proof. We start with the optimal-dual-based ^i-analysis approach as posed in (|13p . Let x = D*f + 
Pg, then we have Dx = f. Since both f and g are free, then x £ R . Put the two facts into (|13p . we 
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obtain the ^-synthesis method On the other hand, we start from the ^i-synthesis formulation. 
For any x£l <! , the following decomposition always holds 

x = in + x N = D*(DD*) _1 Dx + Px 
= D*Dx + Px, 

where xr and x^r are the components of x belonging to the row space and the null space of D, 
respectively. Define f = Dx G M. n and g = x G R , we can arrive at the optimal-dual-based 
^i-analysis approach and the two methods are equivalent. □ 

Remark 1: By taking a geometrical description, it was shown in |16| that any ^-analysis problem 
(with full-rank analysis operator) may be reformulated as an equivalent ^i-synthesis one. Our results 
indicate that the reverse is also true. For a given £i-synthesis problem, there exist some appropriate 
analysis operators (e.g., optimal dual frames of D) such that the corresponding ^-analysis problem 
is equivalent to the ^i-synthesis one. 

With this equivalence, we now establish the error bound of the £i-synthesis approach. Since D Q 
is some alternative dual frame of D, i.e., DD* = I, a direct application of Theorem [T] leads to the 
following results. 

Theorem 3. Let D be a general frame ofM. n with frame bounds < A < B < oo. Let D be some 
optimal dual frame of D defined in (|14p with frame bounds < A < B < oo, and let p = s/b. 
Suppose 

(l-y/p~BL\\ ■ 6 s+a + pBB ■ 5 b < 1 - 2y/pBB (20) 

holds for some positive integers a and b satisfying < b — a < 3a. Then the solution f to (|3|) (or to 
(p73|) ) satisfies 

||f - f || 2 < Co • e + d • ll P of-(Dof) a ||i (21) 

Vs 

where Co and C\ are some constants and (D*f ) s denotes the vector consisting the largest s entries 
of D*f in magnitude. 
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Theorem shows that, under suitable conditions on the sensing matrix, the recovered signal 
f by ^i-synthesis is very accurate provided that D*f has rapidly decreasing coefficients. By the 
optimality of D Q , one may expect that D Q will promote high sparsity in the frame expansion of 
the signal f . Indeed, as we shall see in the numerical experiments, D Q is much more effective in 
sparsifying f than the canonical dual frame does. Consequently, in comparison to the standard 
£i-analysis approach, a better signal recovery is often achieved by -^-synthesis. 

More importantly, this new performance analysis result is capable of explaining examples of suc- 
cessful solutions and fine approximations by the £i-synthesis approach while the recovered coefficient 
vector x is no where near its true value. Known performance analysis results would not have such 
capacity. 

4 Numerical Results 

In this section, we present some numerical experiments to demonstrate the effectiveness of the 
performance analysis results for ^-synthesis. In these experiments, we use two types of frames: 
Gabor frames and a concatenation of the coordinate and Fourier bases. The sensing matrix $ is a 
Gaussian matrix with m = 32, n = 128. Since the dependence on the noise in the error bound (I21D 
is optimal and for the purpose of clarity, we only consider the noise-free case. Both ^-analysis and 
^i-synthesis problems are solved by the algorithm developed in |22j because the returned auxiliary 
variable (Pg) by this algorithm can be used to construct the optimal dual frame D Q (I19p . For 
completeness of this paper, this algorithm is included in Appendix|XJ We set A = fi = 1, tol = 10~ 12 , 
nlnner = 5, and nOuter = 100 in this algorithm for all experiments. 

Example 1: Gabor Frames. Recall that for a window function g and positive time- frequency 
shift parameters a and /3, the Gabor frame is given by 




(22) 
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For many practical applications such as radar and sonar, the received signal / often has the form 

s 

f{t) = Ys a k9(t-t k y^ t . (23) 

k=l 

Evidently, / is sparse with respect to a Gabor frame. In this experiment, we construct a Gabor 
dictionary with Gaussian windows, oversampled by a factor of 30 so that d = 30 x n = 3840. The 
tested signal f is sparse with respect to the constructed Gabor frame with sparsity s = ceil(0.2 x m) = 
7. The positions of the nonzero entries of the coefficient vector x are selected uniformly at random, 
and each nonzero value is sampled from standard Gaussian distribution. 

Figure [2] (a) shows that when D is highly coherent with coherence! /^(D) = 0.9934, the recovered 
coefficients by the £i-synthesis are disappointing (with a relative error ||x — x||2/||x||2 = 0.9039). 
However, the signal recovered by the £i-synthesis is nevertheless quite acceptable (with a relative 
error equal to 0.0845), see Figure [2] (b). This example tells us that a good recovery of the coefficients 
x may be unnecessary to guarantee a fine reconstruction of the signal f. This phenomenon is 
explainable by the new performance analysis result, but not by performance results based on the 
accuracy of the recovery of the coefficient vector x. 

Figure [2] (b) also shows that the signal recovery via ^i-synthesis is much better than that of 
£i-analysis (relative error: 0.0845 vs. 0.3445). This is because the optimal dual frame D Q is much 
more effective in promoting sparsity in the frame expansion of f than the canonical dual frame D 
does. Figure [2] (c) compares the largest 100 coefficients (in magnitude) of D*f and D*f, where D* 
is determined by (fl~9|) . 

Example 2: Concatenations. When signals of interest are sparse over several orthonormal 
bases (or frames), it is natural to use a dictionary D consisting of a concatenation of these bases 
(or frames). In this experiment, we consider a dictionary consisting of the coordinate and Fourier 
bases, i.e., D = [I, F]/y/2. The tested signal f is a linear combination of spikes and sinusoids, i.e., 



4 The coherence of the dictionary D is defined as //(D) = max ji^rfj^f^ , where dj and denote columns of D. 
We say that D is incoherent if fi(D) is small. 
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f = fi + f2 = xi + Fx2. The sparsity of both xi and X2 is equal to 4. Again, the positions of 
the nonzero entries of both xi and X2 are selected uniformly at random, and each nonzero value is 
sampled from standard Gaussian distribution. 

Figure [3] (a) and (b) show that when D is incoherent (with coherence //(D) = 1/y/n = 0.0884), 
the i\ -synthesis approach not only recovers the signal f but also the coefficient vector x accurately. 

Figure [3] (b) also shows that £i-analysis fails in recovering the signal with a relative error at 
0.8143. Such a failure is not surprising since D = D is ineffective in sparsifying the true signal f , 
see Figure (c) . By contrast, D*f decays very quickly, which guarantees the good recovery for the 
signal by ^i-synthesis. 

5 Conclusions 

This paper has presented a novel performance analysis for ^-synthesis in which the dictionary may 
be highly coherent. Our approach was to show the equivalence between t\ -synthesis and optimal- 
dual-based £i-analysis. With this equivalence, the signal recovery error bound for both could be 
established by using the results in |22j . Finally, the results obtained in this paper were validated 
via numerical experiments. 

A Split Bregman Iteration for optimal-dual-based ^-analysis 

This appendix includes the split Bregman iteration for optimal-dual-based £i-analysis in which 

• f: the recovered signal; 

• x: the recovered coefficient vector; 

• Pg: the auxiliary variable used to construct the optimal dual frame of D; 

• shrink(-): denotes the element-wise soft shrinkage operation; 
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Figure 2: D = Gabor frame, (a): recovery in coefficient domain by -^-synthesis (relative error: 
0.9039) with the relative error defined as ||x — x||2/||x||2. (b): recovery in signal domain by l\- 
analysis (relative error: 0.3445) and ^-synthesis (relative error: 0.0845) with the relative error 
defined as ||f — f ||2/||f \i- (c) : The largest 100 coefficients of the coefficient vector D*f and D*f in 
magnitude. 
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Figure 3: D = [I, F]/y2. (a): recovery in coefficient domain by £i-synthesis (relative error: 7.7681 x 
10 -6 ) with the relative error defined as ||x — x|| 2/ ||x|| 2 - (b): recovery in signal domain by ^-analysis 
(relative error: 0.8143) and £i-synthesis (relative error: 6.7911 x 1CT 6 ) with the relative error defined 
as ||f — f ||2/||f lb- (c): The largest 100 coefficients if the coefficient vector D*f and D*f in magnitude. 



• (.) new : denotes either (-) k+1 if it is available or (-) k otherwise. 



Algorithm 1: Split Bregman Iteration for optimal-dual-based ^-analysis 
Initialization: f° = 0, x° = b° = Pg° = 0, c° = 0, jjl > 0, A > 0, nOuter, nlnner, tol; 
Output: f, x, Pg; 

while k < nOuter and ||3>f fc — y|| 2 > tol do 
for n = 1 : nlnner do 

ffc+i = ^<£*<f> + ADD*)-V**(y - cfc ) + AD(x raeu ' - Pg new - b new )}; 
x fc+i = s hrink(D*f new + Pg new + b new , 1/A); 

_ y^new _|_ ^£y*fnew _|_ pgfieui ^newy 

end 

c fe+i = c fe + ($ffc+i _ y ) ; 
Increase /c; 
end 
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